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Ladder  forms  are  probably  the  most  promising  canonical  forms  in  estimation 
and  system  identification.  Many  record  applications,  such  as  in  geophysical 
signal  processing,  high  resolution  (^maximum  entropy^*)  spectral  estimation  and 
speech  encoding.  Justify  the  Interest  in  these  forms.  They  appear  in  many 
contexts,  such  as  scattering  and  network  theory  and  the  theory  of  orthogonal 
polynomials.  The  state-space  model  ladder  realizations  are  very  closely  related 
in  (block)  Schwarz  matrix  canonical  forms,  which  generally  appear  in  the  context! 
of  stability  analysts.  In  fact  they  are  the  natural  ^stability  canonical  form'*.^ 
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leads  also  to  close  connections  to  square-root  algorithms  including  the 
ones  of  Cholesky  and  Chandrasekhar  type,  since  again  Ladder  forms  are  the 
natural  canonical  forms.  In  realization  theory  these  forms  are  obtained 
via  orthonormal  state-space  bases  using  Gram-Schmldt  type  procedures. 
Ladder  forms  have  many  other  advantages,  such  as  lowest  computational 
complexity,  good  numerical  behavior,  stability  "by  inspection"  properties 
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correlation  coefficients,  and  perhaps  absorption  coefficients,  k 

We  shall  present  an  outline  of  some  newer  results  connecting  these 
topics  and  present  new  examples  of  our  new  exact  least-squares  recursions 
for  ("adaptive")  ladder  forms  with  poles  and  zeros.  We  close  witl^  a few 
simulation  examples,  including  the  identification  of  a layered  media 
(via  ultra-sound) . 
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Abslracl 

torins  arc  proliahly  the  mo.<L  promising  canonical  forms  in 
CKliiiotinn,  anil  cyxlrni  iilcntification.  Many  rerent  applications,  such  as 
in  frophysiral  signal  processing,  high  rcsniiilion  (“niaiiniuni  entropy") 
spectral  estimation  ami  s,->ccch  cnco-ling,  justify  the  interest  in  these 
forms.  'I’hry  appc.sr  in  many  contests,  such  as  scattering  am!  network 
theory  ami  the  theory  of  orthogonal  polynomials.  'I  he  state-space  nioilcl 
laililcr  realisations  are  very  closely  relatcil  to  (Mock)  Schwars  matris 
canonical  forms  which  gcocrally  appear  io  the  contest  of  stability 
analysis,  .fn  fact  they  arc  the  natural  "stability  canonical  form*  for 
(iliscretc-linic)  t.yapuno*  c>)ual)Ons  since  the  as.sociatcil  positive  definite 
(covariance)  matrices  arc  di-igonal  resp.  an  Identity.  ITiis  fact  leads  also 
to  close  ennnections  to  square-root  algorithms  including  the  ones  of 
Cholcsky  and  Chandrasrkhar  type,  since  sgain  ladder  forms  arc  the 
natural  canonical  forms.  In  realisation  theory  these  forms  arc  obtained 
via  orlhononnal  slate-space  bases  using  Crain-Schmidt  type  procedures. 
I.addrr  forms  have  rnany  other  advantages,  such  as  lowc.st  computational 
cotnpleiily,  food  numerical  behavior,  stability  "by  inspection"  properties 
and  relations  to  physical  properties  such  as  reflection  or  partial 
correlation  coefficients,  and  perhaps  absorption  coefficients. 

We  shall  present  an  outline  of  gome  newer  results  coniiceling  these 
topics  and  present  new  csatnpics  of  our  new  exact  least-squares 
recursions  for  ("adaptive")  ladder  forms  with  poles  and  xcros.  We  close 
with  a few  simulation  examples,  including  the  identification  of  a layered 
metlia  (via  ultra-sound! 

1.  Iniroduclion 

Ladder  forms  Lave  allracled  much  attention  recently  because 
they  are  probably  (he  most  promising  cansnical  forms  in  estimation 
and  system  identification.  These  forms  hive  appeared  in  many 
applications  such  as  geophysical  signal  processing  for  quite  some 
time  , aiwl  more  recently  such  modtis  are  being  used  in  high 
resolution  (“maximun  entropy”)  speclr.il  estimation  antf  speech 
♦rcoding.  (.adder  ( sometimes  called  lattice  - a tern  vre  would  like 
to  reserve  for  two  and  higher  dimen;ional  extensions  [l.KM])  forms 
appear  in  many  contexts,  first  perhaps  in  scalteriiig  and  network 
theory  where  the  scattering  of  waves  :n  layered  media  or  in 
(n-on-liomogeneo’.is)  transmission  lines  leatls  very  naturally  to 
larJtler  forms,  see  e-g.  (Cla2l,  (LKF),  (hMVj,  [Kellyl 

ladder  forms  appear  explicitly  but  more  often  irnphcitlv  in 
many  contexts.  They  are  directly  tehicd  to  the  scattering  of 
waves  and  therefore  perhaps  first  intrctt.iced  in  physics,  btnie  of 
the  associated  mathematics  are  used  in  network  theory,  where  the 
casiadt-  siiucturi-  of  ilic  ladder  forms  p’.a/s  an  ir.poitiiit  loie.  The 
notion  of  transfer  functions  leads  very  naturally  to  the  next 
connection,  the  theory  of  orthogonal  polynomials.  They  in  turn  also 
appear  in  the  stability  analysis  of  linear  systems.  The  state-space 
nioiUls  that  are  related  to  otlhogonil  (matrix)  polynomials  are  the 
se-callcd  (block)  Schwari  matrix  canonic  il  forms,  see  e.g.  [AJM], 
(Sbl  However,  the  special  structure  of  these  matrices  leads  very 
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directly  to  the  ladder  realizations  IMoJ  In  fact  they  arc  the 
natural  "stability  canonical  form"  for  (discrete-time)  Lyapunov 
equations,  since  the  associated  positive  definite  (covariance) 
matrices  are  diagonal  or  respectively  an  identity  matrix.  The 
similarity  transformations  to  this  form  involve  a matrix 
square-root  of  the  associated  covariance  matrix.  The  ladder  forms  ' 
are  therefore  closely  connected  to  square-root  algorithms 
including  the  ones  of  Cholesky  and  Chandrasekhar  type.  In 
realization  theory  these  forms  are  obtained  via  orthonornaal 
slate-space  bases  using  Cram-Schmidl  type  procedures,  due  to  the 
fact  that  this  ortho-normalization  is  again  related  to  matrix 
square-root  and  orthogonal  polynomials. 

Ladder  forms  have  many  other  interesting  properties.  Due  to 
the  fact  that  they  are  in  many  problems  the  "natural  canonical 
form”,  they  lead  to  algorithms  with  lowest  computational 
complexity  compared  to  other  canonical  forms.  Although  a detailed 
study  is  still  outstanding,  there  are  many  indications  that  this  form 
leads  to  good  numerical  behavior  of  the  associated  algorithms,  a 
properly  that  is  not  shared  with  ' most  canonical  forms. 
Furthermore,  the  stability  "by  inspection"  property  given  the 
Udder  coefficients  is  shared  only  by  the  Jordan  or  modal  canonical 
form.  However,  the  Utter  one  requires  the  knowledge  of  the 
eigen-values  that  are  in  general  not  very  easily  obtained,  compared 
to  the  finite  algorithm  required  to  get  the  Udder  coefficients. 

They  in  turn  have  other  interesting  interpretations  and  relations 
to  physical  properties  such  as  reflection,  and  perhaps  absorption 
coefficients.  In  stochastic  process  modeling  and  spectral  eslitnalion 
the  Udder  coefficients  turn  out  to  be  partial  coirclatiori  or 
canonical  correlation  coefficients,  which  leads  to  very  simple  j 

methods  to  determine  these  parameters  either  from  covariance  I 

data  or  even  directly  from  measured  data. 

!n  (MLNV)  we  presented  a classification  of  exact  least-squares 
modeling  methods.  The  material  discussed  here  is  a sequel  to  the 
results  discussed  there,  in  particular  we  will  concentrate  hure  on  i 

*he  Udder  forms  and  the  assoruthd  <lgorilhms.  V/e  shall  present 
an  o'jltirie  of  rome  newer  results  ront'ccling  these  toyitj  and 

piuaurit  new  examples  of  our  new  exact  least-squares  recuriions 
for  {'idap live")  ladJar  forms  wilii  pules  ;r,d  zeros.  Wr  close  v/iih 
a few  simulation  examples,  including  the  identification  of  a layered 
media  (via  ultra-sound). 

)l.  Ladder  Realizations 

In  [MLNVI  and  (MVLj  we  discussed  various  ladder  realizations. 

We  assume  here  familiarity  with  this  material  and  would  like  to 
give  here  only  a missing  link  to  slate  space  realizations,  namely  the 
fact  that  the  ladder  forms  can  be  obtained  via  an 
ortho-normalization  of  the  state  space.  In  this  context  il  is  well 
known,  that  various  canonical  stale  space  realization  can  be 
obtained  via  methods  that  construct  a basis  of  either  the  Hankel 
matrix  of  the  Markov  parameters,  resp.  the  impulse  response 
parameters  of  the  system,  or  bases  of  the  controllability  or 
observability  matrices  of  the  system,  see  e.g.  IK-S74).  V'c  will  . 
present  here  an  outline  of  the  scalar  discrete-lime  constant 
paianieter  ease.  For  convenience  we  use  an  intermediate  canonical 
form,  the  controller  form.  Il  has  the  properly  that  the  i'^ 
component  of  the  ri  stale  vector  x'(x)  can  he  obtai.ncd  from  the 
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input  uU)  ill  /-trantforni  notation  via  r'(i)  - u(*)t"'7n(a)  , where 
ii(*)  i'.  the  characteristic  polynomial.  The  ladder  forms  arc 
obtained  in  a similar  nianner  via  r|'U)  - i>(z)/i'(z)/a{a)  , where  h'{z) 

IS  the  i‘*  Iduil)  ortho -nor mil  polynomial  oii  the  unit  circle  [Sic]. 
Writinc  these  facts  in  matrix  notation,  we  obtain  the  results  that 
the  the  slate  at  time  n is  jiven  by- ufn-I.O],  u(i.>]  » [u., 

....  Uy]  , where  is  the  usual  controllability  matrix.  For  the 
controller  form  it  is  now  not  too  surprising  that  ~ 

(/7'(n,,...,n^)  ’ , the  inverse  of  a unit  upper  triangular  Toeplitz 
matrix  of  the  coefficients  of  aU) . the  Ladder  forms  on  the  other 
hand  result  in  (see  iMo])  Cj  • iy7(n,,...,n^)'*  , where  is  a 

lower  triangular  matrix  containing  as  rows  the  coefficient  vectors 
of  t'(z).  Due  to  its  orthogonality  property  - R , the  n by 

n I'oeplitz  matrix  associated  with  the  (Z-transformed)  correlation  ' 
function  RU)  - l/|a(z);^  . R^  is  also  the  steady  state  covariance 
matrix  of  the  controller  form  R^*,  if  u(z)  the  input  is  a white 
process.  Now,  since  the  similarity  transform  matrix  S from  one 
state  space  form  to  an  other  is  given  for  instance  by  the  ratio  of 
the  controllability  matrices,  it  is  clear  that  S - C*  (C')'*  " B,,  - 

(R,i')‘’^*  i.e.  from  an  arbitrary  (controllable)  state  space  form  the 
similarity  transform  is  given  by  the  inverse  square-root  of  the 
steady  state  covariance.  This  leads  finally  to  the  connection  with 
Lyapunov  equation  type  characterization  of  the  Udder  forms, 
namely  that  their  covariances  are  an  Identity  (or  diagonal)  which  is 
precisely  the  characteristic  property  of  Schwarz  matrizes,  see 
[AJM],  the  state  space  feedback  matrix  of  ladder  forms  [Mo].  -Due 
to  limitations  we  defer'a  more  detailed  discussion  of  the  details 
and  various  extensions  to  [ML] 

III.  LS  Recursions  for  Ladder  Forms 

The  Prewindowing  Case 

In  [MLVK]  we  presented  this  case,  for  completeness  and  in 
order  to  correct  some  typographical  errors  v/e  repeat  some  of  the 
equations  here.  Given  a series  of  observations  {>(»), O-SIST"),  where 

[ >■(•)  ) can  be  m vectors,  we  wish  to  find  the  least-squares 
one-strp  picdictor  of  order  p paiainelrized  by  the  (in.atrix) 
coeffii-isr.ls  |/1^  . We  can  define  many  different 

squared  error  criteria  E^f-,  for  i.nstance  as  a function  of  i and  / in 

K,,r  ■ X ‘r.T*'’  • yT«:i-p]. 

(i./i’^yij. ..../iViW),  y’fui-p]  - (y,’....y,V(jn-i) 

An  obvious  choice  from  an  innovations  poinl-of-vi«w  is  (*"(i,/-7’), 
the  "pre- windowing"  case  [MDKVj  If  a « ;>  and  f ’•  T the 
so-called  "coviri.ir.ee"  method  is  obtained  [MDICV]  [MVL],  and  if  « 
“ 0 and  f • T » p 'Wf  get  the  pre-  and  post-windowed  case  or  the 
"correlation"  method  [MG]  The  total  squared  error  can  be 
expressed  as 

E^y  " "■  I ^'r.l  ^,..r  ^r.r  J • 

Y^,y  - [ y[0;-,.) , y[h-;<d] y{TtT-p)  ] (111-2) 

Thus  the  problem  of  determining  A^y  by  minimizing  E^y  leads  to 

A^,  y - , 0, ...  ,0]' , ir  B^^y  - mill  E^  y (111-3) 

Although  is  not  Tcpliiz,  it  still  carries  a certain 

shift-inviriince  structure,  given  by  the  following  identities 


^p.r  “ ♦ yir-r-p]  y[7:r.,,)'  (111-4) 

» f r X r 1 - r B . rl 


i-t.r  * 

XXX.  (Ill-S) 


Define  the  backward  predictor  ll^y  and  the  smoothing  errors  C j. 

«V,r  ^P.T  " f ^ ® ^ i ^’i..7-  ^,..1  “ ytr:r.,i)(iii-6) 

Then  the  forward  and  backward  prediction  errors  (innovations), 
tpj  , and  j. , and  an  auxiliary  scalar  y^y  can  be  defined  by 

VJ  “ V- 

Order  Update  Recursions 

Using  the  three  shift-invariance  identities  for  B _ (|||-S)  and 

#*»• 

using  some  symmetry  properties,  the  order  update  recursions  for 
^p.T  • ^p.T  > ^p.r  > ^^p.r  > ^'p,T 

- I '•p.r  or  - ( o,  B’^y,,  ]' 

(“I-’) 

^P‘i,r  “ f ^p,r  ® * '’p^i.T  ^ 'p»i,r  ®V*i.r  '*'^*‘'* 

^p.t.r  " [ ^p.t,r  J [ ^V.r*  ® 

“ I ®>  ^'p,r-l  J I f trst  block  row  oj  R,,|^r 

" ^^p,T  ~ ^ 'p,r-i  ^p‘i,r 

" ^'p.T  - Vi.r  <>»-« 

The  order  update  recursions  are  very  similar  to  the 
multivariate  version  of  the  Levinson  algorithm,  and  a similar  set  of 
recursions  for  time-update  can  also  be  obtaired  [MDKV]jMo] 

Ladder  Type  Realizatiorj 

Prcmultiplying  the  shove  equations  by  3’tT:T-p»1]  , we  obtain 


the  following  order  update  recursions  for  <^  ]■ » 7 » *7^  j- 

1 

i 

w 

1 

^V't.r  ^ 'p.y-i  '^pX-i 

'r'l.r 

“ 'pX-I 

^P'ix  *n.r  *pX 

%.t.T 

“ “’'r.r 

'^'p»\j^  'p-\X''p'tX  ‘ 

The  "R'atman 

is  obtained  from  (iii-5),(lll-7) 

(cflMV))  via 

* 'p,r*'p.r.i  / ( I - 

and  the  reflection  or  PARCOR  coefficients  are  obtained  by 

« ’ A*..,  ,.Rvnn-ll) 

The  initial  conditions  are  given  by 

*c.r  “ ''o.r  ■ yy  i ^-i,r  “ ® * 

T 

^*0  T “ r " 5)  J^i  y/  “ r-i  * yy  y'y  • 

for  p-sT: 

*p.y  ‘ ‘r.j ! '’e.r  " *’r.r  '<  Vr  " "''tx  • 

B^  _ « B^_  -.  r B^  • R^v  rsA  ,1-  *0; 

As  the  dual  to  the  stochastic  forms  in  [IS]  [Wak]  [Mo]  [SKM] 
equations  (III  8)-(lll  II)  are  a complete  set  of  order  and  lime 
update  recursions  to  obtain  the  exact  least-squares  ladder  form 
predictor,  which  is  shown  in  Figure  1. 
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Figure  I.  /.adder  realUntion  oj  evoct  one-step  least-squares 
predictor. 


Thp  recursion  (lil-10)  computes  the  sample  cross-covariance  of 
the  foriuard  and  backward  innovations,  using  the  optimal 
weighnng  1/(1 -Y.,.),  compared  to  other  suboptimal  schemes  [SVj. 
See  in  the  appendix  a sample  comparison  of  the  exact  versus  two 
approximate  methods.  In  the  scalar  case  if  yg-O,  or  in 

general  if  j j-<l,  since  [MDKV],  (mVLJ.  If  in>l,  we 

require  Tip*m.  These  singularities  can  be  avoided  by  including  a 
priori  estimates  of  the  covariance  or  equivalently  including  a 

weighted  norm  of  the  predictor  a in  the  error  criteria  E _ for 
tracking  of  time-varying  parameters,  e.g.  in  speech  modeling 
methods,  these  equations  can  be  modified,  either  by  puting  an 
exponential  weight  on  past  errors  as  discussed  in  [MKL], 
(implemented  in  the  simulation  in  the  appendix).  Alternatively,  the 
lower  bound  of  the  error  criterion  in  (lll-l)  can  be  increased,  e.g.  i 
- 7’  - / , where  / is  the  (constant)  "sliding"  time  frame  width  of 
the  analysis.  This  corresponds  also  to  a sliding  window  on  the 
prediction  errors.  The  resulting  equations  are  similar  to  the  ones 
inlMVLl 

Instead  of  computing  the  scalars  T one  can  also  work  v/ith  a 
second  set  of  prediction  errors  based  on  the  "old"  parameter 
estimates,  since  , 

" ‘e.r.,  / • 

This  alternate  form  was  also  found  by  J.  Baker,  IBM  Vorktov/n 
(piivate  cn.-nruumcalion).  A similar  situation  occurs  in  the  Fast 
Cholesky  lloasl-squires)  algorithms  for  estimating  moving-average 
piramoters  via  feedback  filters  described  m [Mo],  where  a "second 
filter  or  predictor  filter"  appears  that  computes  variables  of  the 
typf  <,,_j(r‘l)  • It  is  interesting’ to  note  in  this  context,  that  the 
unwindov/ed  C'covariar.ce")  method  aciiiaiiy  also  leads  to  signal 
feedback  ptths  (acloaliy  a smoothing  filter),  see  fMVL],  but  the 
simpler  prewindowing  case  is  feed  forward  only. 

Many  modifications  have  been  proven  useful  in  actual 
implementations,  they  arc  partially  due  to  the  fact  that  many 
additional  identities  exist  and  others  are  due  to  differences  in 
numerical  behavior  and  trade-offs  in  operations  count  and  memory 
requirements.  Systematic  experiments  are  now  in  progress  and  will 
be  reported  on  shortly. 

IV.  LS-Recursion;  for  Rational  Ladder  Forms 
Rational  or  ARMA  Modeling 

Rational  or  pole-iero  or  A?.MA  modeling  methods  were 
described  in  (SLC),  (Mh'L)  and  their  relation  to  joint  innovations 
representation  via  an  imbedding  of  the  AKMA  model  in  a two  (m) 
channel  AR  model  in  LhUNV]  »,-i,i  The  same  idea  also  leads  to 
Stable  partial  minimal  reih/aiions  of  the  joint  impulse-response  and 
covariance-matching  type  [MIMV].  Given  an  ARMA  model  as 
represented  by  the  dif(er<f^<  eq-jai.on  we  can  rewrite  it  as 

>t  * “ly.-i  • • "-y-i.  • '>1  ".  I • •••  " *s“i  • 
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( Cj'  is  the  first  unit  vector).  This  equation  can  be  interpreted  as 
an  AR  mode!  for  the  joint  process  { y,  u ) [MoJ,  since  the  RHS 
is  equal  to  the  joint  innovations  of  { y,  u ) , since 
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following  augmented  equation 
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Stochastic  Case 

From  a stochastic  process  point  of  view  we  can  express  the 
normal  equation  associated  with  the  augmented  AR  model  as 
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We  can  solve  for  the  normal  equation  of  a 


« - I K' «,R*„(iy-s) 

The  equations  (IV-4)  and  therefore  the  non-Tbpliti  equations 
(IV-5)  (!)  can  be  solved  recursively  with  the  LWR  algorithm. 
Note  that  if  - 0 , the  minimal  order  n - k.  We  could  bring 

equations  (IV-4)  into  a more  familiar  form  by  the  interleaving 
permutation  (l,3,5,...,2n-l,2,4,6,...,2n»2),  cf.  (Ml)h.Vj,  to  convert  the 
two-process  covariance  matrix  into  a n by  n block  Teplitr.  matrix, 
with  2 by  2 blocks,  hov.'ever  the  LWR  algoiithm  clearly  applies  to 
both  representations  with  suitable  modifications. 

Thus  we  have  -shown  that  the  joint  impulse  response  & 
covaiiance  matching  problem  is  equivalent  to  solving  a set  of 
normal  equations  associated  with  a two  channel  AR  modeling 
problem.  Since  the  predictor  for  the  joint  process  is  triangular 
and  minimum  phase,  the  denominator  3^  of  the  underlying 
ARMA  model  is  also  minimum  phase  and  therefore  stable,  (for 
s!!  k) 

Equations  (IV-4)  and  the  elegant  stability  proof  were  actually 
first  obtained  by  Claerboul  [Clal]  via  a least-squares  rational 
approximation.  The  connections  between  the  joint  innovations 
representation,  the  augmented  normal  equations,  and  the  Hankel 
matrix  were  pointed  out  in  (Mo)  and  also  in  (MDkV),  [MKD], 
[DKM],  where  algorithms  were  given  to  solve  equations  of  the 
type  seen  in  (lV-4)  and  (IV-S). 


Deterministic  Case 

In  [MLNV]  we  considered  the  deterministic  case  where  we  are 
given  impulse  response  data  or  the  Markov  parameters,  here  we 
shall  assume  that  we  are  given  a series  of  observations  and  we 
want  to  find  a least-squares  (deterministic)  one-step  ARMA 
predictor  recursively  from  the  data  equivalent  to  the  RML 
algorithms  described  in  (SI.C)  and  (MKL).  Our  approach  will  not 
give  a new  way  how  to  derive  these  algorithms,  but  it  will  also 
give  us  very  quickly  the  ladder  forms. 

Writing  the  input/output  relationship  in  matrix  notation  yields 
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whore  lowcr-trirticuhr  and  Hlj.  is  a full  matrix,  but  both  arc  a 
product  of  two  Toplitr  matrices  ‘containing  the  data  and  the 
normalirod  one-stop  prediction  errors,  which  take  place  of  the 
inputs  u - K « , < - y,  - y,t,.)  > v'bore  ^ - K^  j.  in 
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Recursions  for  Rational  Ladder  Forms 
This  partitioning  leads  easily  to  the  rational  ladder  recursions. 
Formally  the  same  recursions  can  be  used.  However,  the  fact  that 
(he  forward  predictor  is  triangular  simplifies  and  actually  makes 
(he  recursions  possible  at  all,  since  the  one-step  prediction  errors 
are  not  needed  until  the  next  iteration,  i.e.  they  are  feed  back 
and  treated  at  the  next  time  slop  as  the  (“other  hsif"  of  the) 
observations.  It  is  easily  verified  in  the  same  context  that  half  of 
(he  entries  in  j.  are*-xero,  which  guarantees  that  (he  one-step 
prediction  errors  are  not  used  before  (hey  are  required  in  the 
recursion.  The  following  Figure  2.  cleaily  shows  (his. 
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Fignre  2.  Rntiot'ol  Ladder  realisation  of  exact  ong-aep 
least  if^uarct  predictor. 

Appendix:  Computer  Simulations 

Layered  Media  Identification 

The  inodc’ling  on  of  layodej  media  is  of  interest  in  many  treas, 
notably  in  Geophysics,  see  c.g.  Claorbout  [Clal,2]  and  more 
recently  in  medical  imaging  or  nondestructive  testing.  There  are 
two  basic  situations  that  occur  in  these  areas.  The  first  one, 
where  the  source  is  on  the  opposite  side  of  the  receiver  is  the 
straight  forward  case,  it  leads  to  auioreg.ressive  or  all-pole  models, 
wich  can  be  readily  iden.’i.'ird  by  using  the  various  methods  to 
estimate  reflection  coefficients  bv  cross-correlation  of  the 
forward  arid  backward  residuals  in  the  whitening  filter  in  ladder 
form,  see  e.g.  (Cla!,?).  The  second  case,  where  the  source  and 
receiver  are  on  the  same  side  did  up  to  now  not  lead  to  such 
simple  proressiiig  as  the  first  case,  because  the  (imput)  transfer 
function  is  rationil  in  gcneril,  or  in  the  best  case  where  a total 
reflection  occurs  within  some  liver  the  -transfer  furiclion  is  an 
all-pass  rietv.'ork.  In  this  case  ih'-  zeros  are  equil  to  the  reflected 
poles  and  the  'leflection  coclficnn.ls’  of  the  numerator  polynomial 


arc  the  negative  of  the  ones  of  the  denominator  polynomial  of  the 
transfer  function.  We  can  readily  see  then,  that  our  raticmal 
ladder  form  specialir.cs  and  v/c  gel  only  one  set  of  reflection 
coefficients  that  can  be  associated  w'ith  the  ones  of  the  layered 
medium  that  generated  the  data.  This  particular  ease  is  treated 
from  a circuit  point  of  viev/  by  Kung  iKunl  Figure  3 shows  an 
example  using  real  ultrasound  returns  and  the  estimates  of  the 
reflection  coefficients  using  a ladder  structure. 


fdcHtificatioii  of  a layered  media  wc  ultrasound.  | 

The  expeiiments  W'ere  performed  hy  Linda  Joint  arid  Hough  Boyd  | 

in  the  Stanford  F.ltclronics  Laboratory  of  Prof.  j.  Meindl.  The  , 

reflection  coefficient  estimates  appear  to  be  much  smaller  than  I 

anticipated  from  the  eapeiimenlal  set  up,  this  if  due  to  rcvcril  I 

factors:  The  ladder  structure  actually  idenlilies  not  only  the  | 

mculurii  and  the  single  ivfluciing  plate  in  the  path  of  the  ultrasound  | 

beam,  but  also  computes  an  equivalent  layer  model  for  the 
transducer.  The  estimated  values  of  the  first  large  reflection  j 

coefficients  show,  that  the  transducer  is  very  inefficient  and  not  j 

very  well  matched  because  the  largest  value  is  very  close  to  one,  j 

which  tend  to  "turn  off"  all  higher  order  reflection  coefficients.  j 

Further  more,  because  of  the  wavelengs  used  the  layers  of  the  | 

medium  have  a.  continuous  reflection  coefficient  density  which  I 


indicates  that  this  direct  scheme  must  fail  since  w’e  tried  to 
estimate  the  derivative  of  a function  (with  noisy  data!)  It  would 
require  the  use  of  a modified  ladder  form  that  is  paramcleriied  by 
the  equivalent  of  the  "area  function"  used  for  instance  iii  the 
speech  modeling  context  (WakJ. 

Sample  Comparison  of  Different  Reflection  Coefficient  Estinaaies 
Ladder  coefficient  csiimales  were  in  the  past  said  to  converge 
very  slowly,  indeed  this  is  the  ease  for  approximate  recursive 
methods  as  demonstrated  in  the  Figure  <,  where  three  methods  are 
compared.  Two  approximate  recursive  methods  using  arithmetic 
me.an  definitions  of  the  prediction  error  (see  e.c.  [Mak],  (MLVK)) 
and  and  other  compulalionaly  attractive  method  using  the  average 
of  the  product  of  iho  signs  of  the  forward  and  backward 


prc(lic«'ror  error,  which  irises  from  1.1  norrn  considerilions  see 
Cl»erbout[Cli3)  »nd  his  oficn  been  used  in  circuit  design. 
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Figure  4:  Comparison  of  Two  Approximate  and  One  Exact 
Hecursive  Method. 

The  third  method  uses  our  recursive  exict  least-squsres  equations 
(pre-windowed  case).  The  first  two  schemes  give  very  similar 
results,  i.e.  a bias  of  f)0Z  on  the  only  nonzero  third  reflection 
coefficient  (-.8)  and  sidelobes  as  high  as  20/C  and  18/C  typical  value, 
whereas  our  exact  method  has  virlualy  no  bias  and  half  the  maximal 
and  typical  sidelobe  values.  Furthermore,  they  actually  converged 
already  after  around  38  samples  compared  with  the  200  samples 
used  in  Figure  4 . We  niay  note  that  the  other  schemes  took  much 
longer  to  actually  converge. 
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